Percepción de estudiantes de pregrado de Medicina de talleres de simulación de procedimientos médico-quirúrgicos / Undergraduate student's perception of clinical simulation workshops: assessment of an instrument

Background: Simulation is a useful training tool for undergraduate medical students. A valid instrument is needed to assess students' perception of simulation workshops. Aim: To adapt and validate an instrument to assess the undergraduate medical student's perception of simulation workshops of clinical procedures. Material and Methods: Delphi Methodology was used to adapt the instrument. Exploratory and confirmatory analyses were performed to determine the construct validity and Cronbach's Alpha (0 to 1) for internal consistency of the instrument. Results: A Delphi panel of 10 experts adapted a seven-item questionnaire (Likert scale 1-5; ranging from 7 to 35) and four open-questions. After 3-delphi-rounds, the instrument was administered to 210 students in six simulation training programs (Paracentesis, Cardiopulmonary Resuscitation, Airway management, Sutures, Thoracentesis and Nursing Procedures). The instrument was considered unidimensional in the factorial analysis. The overall median (Q1-Q3) score was 34 ranging from 32 to 35 and the Cronbach Alpha coefficient was 0.72, indicating a good reliability. Conclusions: The perception questionnaire is a useful and reliable instrument to assess students' perceptions of clinical simulations.

Evaluación de docentes clínicos de Postgrado: desarrollo y propiedades psicométricas del instrumento MEDUC-PG14 / Development of MEDUC-PG14 survey to assess postgraduate teaching in medical specialties

Background: Feedback is one of the most important tools to improve teaching in medical education. Aim: To develop an instrument to assess the performance of clinical postgraduate teachers in medical specialties. Material and Methods: A qualitative methodology consisting in interviews and focus-groups followed by a quantitative methodology to generate consensus, was employed. After generating the instrument, psychometric tests were performed to assess the construct validity (factor analysis) and reliability (Cronbach’s alpha). Results: Experts in medical education, teachers and residents of a medical school participated in interviews and focus groups. With this information, 26 categories (79 items) were proposed and reduced to 14 items (Likert scale 1-5) by an expert’s Delphi panel, generating the MEDUC-PG14 survey, which was answered by 123 residents from different programs of medical specialties. Construct validity was carried out. Factor analysis showed three domains: Teaching and evaluation, respectful behavior towards patients and health care team, and providing feedback. The global score was 4.46 ± 0.94 (89% of the maximum). One teachers’ strength, as evaluated by their residents was “respectful behavior” with 4.85 ± 0.42 (97% of the maximum). “Providing feedback” obtained 4.09 ± 1.0 points (81.8% of the maximum). MEDUC-PG14 survey had a Cronbach’s alpha coefficient of 0.947. Conclusions: MEDUC-PG14 survey is a useful and reliable guide for teacher evaluation in medical specialty programs. Also provides feedback to improve educational skills of postgraduate clinical teachers.

Evaluación para el aprendizaje: experiencia en un curso teórico de pregrado en medicina / Assessment for learning: experience in an undergraduate medical theoretical course

Background: Assessment for learning is a paradigm that is taking shape in the field of medical education. This approach aims to embed the assessment process within the educational and learning process. Aim: To evaluate the impact of curricular changes, from a focus of assessment of learning to one of assessment for learning, in the perception of undergraduate students of medicine and their final grades obtained in a theoretical course (TCG). Material and Methods: In the year 2011 lectures were reduced and intermediate assessments followed by a feedback session were introduced. The activities of each program course, surveys about student perceptions of the course and the final grades of students (assessments with multiple choice questions) were compared between the periods prior and after curricular changes (2005-2010 and 2011-2013). Results: As a consequence of curricular changes, time for lectures was reduced by 19.5%, time for summative assessments was increased by 8.5%, and feedback activity, occupying 7.3% of the course time was added. There were significant improvements in student is perceptions in all areas assessed by surveys, emphasizing feedback and assessments. The overall grade assigned to the course dictated after implementing the changes increased from 6.18 to 6.59 (p < 0.001, 1-7 scale). The grades of students also improved from an average of 5.78 to 6.43 (p < 0.001, 1-7 scale). Conclusions: Assessment for learning achieved the desired educational impact without increasing the assigned curricular time. Programmatic assessment is favorably perceived by students.

Incorporación de paciente virtual en portafolio de estudiantes de medicina de pregrado / Introduction of virtual patients to clinical case portfolios for undergraduate medical students

Background: In 2007, a Clinical-Case-Portfolio (CCP) was introduced as a new assessment instrument for fourth grade undergraduate medical students. Since then, several changes have been implemented such as reduction on the number of clinical cases, peer review and the introduction of virtual patient to the portfolio. Aim: To describe the virtual patient model incorporated to the CCP and assess the perception of this change and its effects on the performance of undergraduate students. Material and Methods: Virtual patients were implemented based on prototype clinical cases with specific syndromes. Students’ perceptions about CCP before and after the introduction of virtual patients were evaluated using a validated questionnaire that was answered voluntarily and anonymously. Results: Overall perception of CCP significantly improved after the incorporation of virtual patients (97.1 ± 24.9 and 111.3 ± 25.7 points; 57.8 and 66.2% respectively). The same improvements were observed for the domains “Student Learning”, “Organization and Evaluation”, “Teaching Methodology” and “Integration”. In both years, students obtained high grades in CCP evaluations. However CCP grades were not significantly correlated with integrated final grades. Conclusions: The incorporation of virtual patients improved undergraduate students’ perception of CCP.

Identificación de las necesidades de capacitación docente de los jefes de programa de especialización médica / Identifying the main training needs of postgraduate medical program managers

Training of postgraduate medical specialty program managers (PMSPM) is essential for the proper development of their programs. Aim: To identify the main training needs of PMSPM at a medical school. Material and Methods: A mixed-methodology approach was implemented including focus group/interviews and the administration of the Program Managers Training Needs Assessment Questionnaire (PROMANAQ) developed by an expert panel with 59 items (with two sections: relevance/performance-self-perception). Higher priority was assigned to items with high relevance and low performance. Results: Forty five PMSPM completed the PROMANAQ (81.8% response rate). Both sections of PROMANAQ were highly reliable (Cronbach alpha of 0.95/0.97 for relevance/performance-self-perception, respectively). The items with higher priority value were evaluation of clinical educators, evaluation of teaching programs and accreditation of programs. Ten PMSPM were included in the focus group (18.2% of the universe). The findings of the qualitative component were concordant with the areas explored in the questionnaire. Conclusions: The PROMANAQ is valid and reliable to identify the training needs of PMSPM. The views of PMSPM must be taken into account for faculty development planning.

Niveles séricos de alanino-aminotransferasa en población chilena: análisis de los resultados de la encuesta nacional de salud 2009-2010 / Serum levels of alanine aminotransferase in Chilean population: analysis of results of the national health survey 2009-2010

Background: Determination of Alanine aminotransferase serum levels ([ALT]s) is a sensitive ana reliable test for liver diseases. Aim: To report the prevalence of abnormal [ALT]s in Chilean population and to identify associated variables. Methods: We analyzed data from a random sub-sample of 2,794 adults surveyed during the second Chilean National Health Survey. Abnormal [ALT]s were defined by using three different cut-off values (COV), two fixed COV (COV1: > 30 IU/L in men and > 19 IU/L in women and COV2 pre-defined by the performing laboratory) and a COV adjusted by age, weight and sex (COV3 > 31 IU/L for women and > 44 IU/L and men > 42 IU/L and > 66 IU/L with a BMI > 23). Logistic regression analysis was performed to determine risk factors for elevated [ALT]s Results: Mean [ALT]s values were 30.14 I U/L in men and 22.03 IU/L in women. The observed prevalence of abnormal [ALT]s defined by different COV were 38%, 11.5%, and 8.1% for COV1, COV2 and COV3 respectively. Variables independently associated to abnormal [ALT]s in a multivariate analysis were the following: serum gamma-glutamyl-transpeptidase (OR: 1.055 [95% CI 1.033-1.078]) and body mass index (OR:1.13 [95% CI 1.09-1.17]). Variables inversely associated with abnormal [ALT]s (COV1) were mole gender (OR-.0.976 [95% CI 0.96-0.99) and HDL-cholesterol (OR:0979 [95% CI 0.96-0.99]). Conclusions: Independently of the COV used, Chilean population exhibits a high prevalence of abnormal [ALT]s which may reflect a significant burden of liver disease. Non-alcoholic fatty liver disease could be a major contributor to elevated [ALT]s considering the association of abnormal [ALT]s and metabolic variables.

Evaluación del ambiente educacional en programas de especialización médica / Evaluation of the educational environment in medical specialty programs

Background: The Postgraduate Hospital Education Environment Measure (PHEEM) questionnaire, is a valid and reliable instrument to measure the educational environment (EE) in postgraduate medical education. Aim: To evaluate the EE perceived by the residents of a postgraduate training program using the PHEEM. Material and Methods: The PHEEM was applied in 2010-2011 in 35 specialty programs. We calculated their individual results and compared means of both global and individual domain scores of the PHEEM, by gender, university of origin and nationality. Cronbach's alpha coefficients and D study (Generalizability theory) were performed for reliability. Results: Three hundred eighteen residents were surveyed (75.7% of the total universe). The mean score of the PHEEM was 105.09 ± 22.46 (65.7% of the maximal score) which is considered a positive EE. The instrument is highly reliable (Cronbach's alpha = 0.934). The D study found that 15 subjects are required to obtain reliable results (G coefficient = 0.813). There were no significant differences between gender and university of origin. Foreigners evaluated better the EE than Chileans and racism was not perceived. The programs showed a safe physical environment and teachers with good clinical skills. The negative aspects perceived were a lack of information about working hours, insufficient academic counseling, and scanty time left for extracurricular activities. Conclusions: This questionnaire allowed us to identify positive aspects of the EE, and areas to be improved in the specialty programs. The PHEEM is a useful instrument to evaluate the EE in Spanish-speaking participants of medical specialty programs.